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We consider a stochastic Hodgkin-Huxley model driven by a periodic signal as model for the 

membrane potential of a pyramidal neuron. The associated five dimensional diffusion process is a 
time inhomogcncous highly degenerate diffusion for which the weak Hormandcr condition holds only 
locally. Using a technique which is based on estimates of the Fourier transform, inspired by Fournier 

IT) 

2008, Bally 2007 and De Marco 2011, we show that the process admits locally a strictly positive 
continuous transition density. Moreover, we show that the presence of noise enables the stochastic 
^ — system to imitate any possible deterministic spiking behavior, i.e. mixtures of regularly spiking 

and non-spiking time periods arc possible features of the stochastic model. This is a fundamental 



difference between stochastic and deterministic Hodgkin-Huxley models. 
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1 Introduction 



In this paper we study stochastic models based on the Hodgkin-Huxley model well-known in physiology. 
Our focus is on the presence of a periodic stochastic stimulus standing for the synaptic input received 
by a neuron from a large number of other neurons. This leads us to the study of a highly degenerate 
non time homogeneous stochastic system which can not be addressed by available techniques from the 
literature. 

The deterministic Hodgkin-Huxley model for the membrane potential of a neuron has been extensively 
studied over the last decades. There seems to be a large agreement (cf. introduction Destexhe 1997) 
that the 4-dimensional dynamical system proposed initially by Hodgkin and Huxley 1951 models 
adequately the mechanism of spike generation in response to an external input, in many types of 
neurons. It describes also the behavior of ion channels with respect to the two ion currents which 
are predominant: import of Na + and export of K + ions through the membrane, via voltage gated 
ion channels of a specific structure. For a modern introduction to the Hodgkin-Huxley model see 
Izhikevich 2009, in particular pp. 37-42 and figures 2.8 on p. 33 and 1.7 on p. 5. 

The deterministic Hodgkin-Huxley system exhibits a broad range of possible and qualitatively quite 
different behavior of its solution, depending on the specific input. Desired periodic behavior (regular 
spiking of the neuron) appears only in special situations. See e.g. Rinzel and Miller 1980 for some 
interval / such that time-constant input c £ I results in periodic behavior of the solution; see e.g. 
Aihara, Matsumoto and Ikegaya 1984 for some interval J such that oscillating input t — > S(ft) with 
frequencies / G J (for some 1-periodic function S) yields periodic behavior of the solution. In case 
of oscillating input, frequency has to be compatible with a range of 'preferred frequencies' of the 
Hodgkin-Huxley model, a fact which is similarly encountered in biological observations (see Izhikevich 
2009, figure 1.7 on p. 5). There are also intervals I and J such that time-constant input c G / or 
oscillating input at frequency / G J leads to chaotic behavior of the solution. Periodic behavior 
includes that the period of the output can be a multiple of the period of the input. Using numerical 
methods, Endler 2012, Section 2, gives a complete tableau. 

The first important question that one has to face when considering stochastic Hodgkin-Huxley systems 
is how to model the synaptic input received by the neuron from the other neurons. Actually, this 
question is a particular case of a more general problem, which is: in which way should 'noise' be 
included in a deterministic system such as Hodgkin-Huxley and what happens if one adds 'noise' to 
the system? There are some simulation studies (e.g., periodic signals embedded in Ornstein-Uhlenbeck 
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type processes: Pankratova, Polovinkin and Mozekilde 2005, Yu, Wang, Wang and Liu 2001), but not 
much seems to be known mathematically. 

In our case, the input is driven by some deterministic T— periodic signal S(t) which is randomly 
perturbed. We think of a cortical neuron which receives this input from its dendritic system. This 
dendritic system has a complicated topological structure and carries a large number of synapses which 
register spike trains emitted from a large number of other neurons within the same active network. 
There are statistical reasons to believe that the cumulated input as a function of time is well modeled 
by a time inhomogenous diffusion process (£t)t>o which is either of Ornstein-Uhlenbeck or of Cox- 
Ingersoll-Ross type, see Hopfner 2007. More precisely, (£t)t>o is the strong solution to the SDE of 
mean-reverting type 

dCt = (S(t) - &) dt + dW t 

whose coefficients are such that 'periodic ergodicity' (cf. Hopfner and Kutoyants 2010, section 2) holds 
for £. The signal S is present e.g. in mean values t — > E(£t) through some deterministic transformation 
of S. The stochastic Hodgkin-Huxley model which we consider is then made of the four classical 



Hodgkin-Huxley variables together with £, see equation (£HH) in Section 2.2 and also equation (HH) 



in Section 2.1 It is therefore a 5-dimensional SDE having the one- dimensional standard Brownian 
motion W driving £ as the only source of 'noise'. For this reason it is a highly degenerate model in 
the sense that neither ellipticity nor the strong Hormander condition are fulfilled. Actually, only the 
weak Hormander conditions holds, and only locally. 

Our model includes the feature of periodic behavior in the sense of a periodic structure of the semigroup 
of a Markov process. Several questions arise in this context: Does the noise have influence on the 
spiking behavior of the system? Does the noise enable a stochastic system to do what a comparable 
deterministic system would be unable to do? Moreover, from a probabilistic point of view it is also 
natural to determine whether there exist continuous transition densities for the system. This would 
show that the interaction between noise and drift can be strong enough to smoothen the degenerate 
5-dimensional diffusion. 

Concerning the last issue, it is now classical to make use of Malliavin calculus techniques relying on the 
so-called Hormander condition. The Hormander condition is satisfied if some Lie algebra generated 
by coefficients of the system has sufficiently high dimension. For the strong Hormander condition, one 
makes only use of the diffusion coefficients to compute brackets, where-else in the weak case one can 
also include the drift. 

In our case we only have the weak Hormander condition, and only locally, and our system is time 
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inhomogeneous. In the non time homogeneous case, to the best of our knowledge, the existing results 
all require at least the strong Hormander condition, see Cattiaux and Mesnager 2002 and the references 
therein. Recently, Bally 2007, Fournier 2008 and De Marco 2012 considered the case of local ellipticity 
(in particular, the strong Hormander holds locally) in a time homogeneous framework with locally 
smooth coefficients. Using a technique based on estimates of the Fourier transform, introduced in 
these papers, we show that continuous transition densities indeed exist locally in all neighborhoods 
of points where the weak Hormander condition is satisfied. This is the content of Theorem [2] and 
Theorem [4} More precisely, we use a localization argument which is based on ideas of De Marco 2012; 
technically our frame is more difficult since our system is not homogeneous in time and since we only 
have the weak Hormander condition locally. 

A natural question in this context is to exhibit an explicit set of points where the weak Hormander 
condition is satisfied. We can show numerically that on a specific segment of stability points for the 
deterministic Hodgkin Huxley system with constant input, the local Hormander condition is satisfied. 
Hence, locally at such stability points, continuous transition densities exist. We also can consider 
numerically a stable orbit of the deterministic system with constant input (sufficiently high), where 
a specific part of the orbit -when the membrane potential up-crosses the resting level- belongs to 
the set of points where the local Hormander condition is satisfied. However, in both cases, the weak 
Hormander condition neither is satisfied at all stability points, nor -and by far not- at all points on 
the stable orbit. 

The only existence of continuous transition densities does not imply their strict positivity. Using a 
control argument, we prove in Theorem [3] their strict positivity at stability points and at points on the 
stable orbit where the weak Hormander condition is satisfied. Theorem [3] is interesting also for the 
following reason: it shows that with positive probability, our stochastic Hodgkin-Huxley system with 
T-periodic signal S can imitate any deterministic Hodgkin-Huxley system driven by any T-periodic 
signal S over a certain time interval. Under some restriction on S, this time interval can be arbitrarily 
long. More precisely, given a solution to the deterministic Hodgkin Huxley system associated to S 
over some time interval, small uniform tubes around this deterministic solution will be in the support 
of the law of the stochastic system with T-periodic signal S. Hence, the stochastic system will be able 
to reproduce regularly spiking behavior during some period, followed by completely irregular behavior 
during some other period, followed by sticking to some equilibrium point during again some other 
period of time. 

This gives an answer to one of our questions: The stochastic system with signal S can -with positive 
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probability- mimick deterministic systems with arbitrary S over some time. Another question however 
is not answered by this assertion: what will be typical features of the path of the stochastic Hodgkin- 
Huxley system with T-periodic signal S in the Ion run? We know that the semigroup has a T-periodic 
structure, but neither this nor the preceding assertion allows to deduce what the system will do 
'typically' when time tends to oo. This is the question of determining whether the 5-dimensional 
stochastic system is periodically ergodic which is outside the scope of the present paper. 

Our paper is organized as follows. We present the deterministic and the stochastic Hodgkin-Huxley 
system in Section [2| This section contains the main results, Theorem [TJ Theorem [2] and Theorem 
[3j on the existence of continuous transition densities and their positivity. Section [4] is devoted to 
the study of smoothness properties of densities for strongly degenerate inhomogeneous SDE's and 
contains Theorem [4] which is stated in a general frame, independently of the Hodgkin-Huxley model. 
The control argument is given in Section [6j The explicit calculation of the Lie brackets is postponed 



2 Deterministic and stochastic Hodgkin-Huxley system. Main re- 



We will consider a neuron modeled by a Hodgkin-Huxley system which receives a periodic input S 
from its dendritic system. The input is random and there are statistical reasons to believe that, as 
a function of time, this random input is well modeled by a time inhomogeneous diffusion of mean 
reverting type, see Hopfner 2007. 

We start by recalling briefly the deterministic model. 
2.1 HH with deterministic T-periodic input 

Let a T-periodic deterministic signal t —> S(t) be given. The Hodgkin-Huxley equations with input 
S(t)dt are 



to Section [U 



suits. 



(HH) 



< 



dht 



dV t 



dn t 



dmt 



S{t) dt -[g K nf (V t - E K ) + g Na mf h t (V t - T Na ) + g L (V t - E h )] dt 
[a n (V t ) {1 - n t ) - p n (Vt)n t ]dt 
[a m (V t ) (1 - m t ) - (3 m (Vt)mt]dt 
[a h (V t ){l-h t ) - (3 h (V t )h t }dt, 
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where 

g K = 36, 5 Na = 120, g L = 0.3, E K = -12, E Na = 120, E L = 10.6, 
with notations and constants of Izhikevich 2009, pp. 37—38. The functions oi n , /3 n , cx m , firm 

a h ,/3 h in 

(HH) take values in (0, oo) and admit a power series representation on JR. They are given as follows. 

= cxpalgffi-i ' M = 0.125 exp(-«/80), 

(1) a m (v) = ^t- , 1 ^ , P m {v) = 4exp(-t;/18) 1 
a h (v) = 0.07exp( W /20), fa{v) = exp(3 -o,i,) + i • 

Define for v G M 

( 2 ) n oo(v) := — C yV(^) , mooO) := — "f^M , ^oo(^) := ^ («) • 

a n + Pn a m + Pm a h + Ph 

If we think of keeping the variable V constant in (HH), then these are equilibrium values in (0, 1) for 
the variables n, m, h when V = v G iR. 

Write Y := (V,n,m,h) for the 4d system of 'biological variables'. Sometimes we associate a fifth 
variable J with dJt = S{t)dt to the system and write X := (V,n,m,h, J) for the 5d system. Fixing 
some open interval U C M large enough to contain all values of the integrated signal J, we write 

E4 := M x (0, l) 3 state space of Y, with points (v, n, m, h) , 
E5 := M x (0, l) 3 x U state space of X, with points (u, n, m, h, () 



(see Section 4.4 for a proof of the fact that the system stays in E± whenever it starts there), and use 



notation F : E4 — > M for drift terms not related to the signal in the first equation of (HH): 

F(v,n,m,h) := g K n A (v - E K ) + g Na m 3 h (v - E Na ) + g L (v - E L ) 

(3) := 36 n 4 (v + 12) + 120 m 3 h(v- 120) + 0.3 (w - 10.6) . 

Define from ([3| a function F^ : M — > M by 

(4) Fooiv) := i ? (u,n 00 (i;),m 00 (v),/i 00 (i;)) , v G M . 
In particular, if we select c G 1R such that c = F^^v), then 

(5) (v,noo(v), mooiv), hoo{v)) G £4 

is an equilibrium point for the deterministic system (HH) with constant signal S(-) = c. 



Example 1 It is well known that for sufficiently large values of constant signal S(-) = c, the deter- 
ministic system (HH) exhibits regular spiking (see Rintzel and Miller 1980, for the model constants 
used here see Endler 2012, section 2.1, in particular figure 2.6). This means that for such values of 
c, the equilibrium point |5[) is unstable, and that there is a stable orbit for the 4- dimensional system 
Y of 'biological variables'. 



2.2 T-periodic diffusions carrying the signal S and HH system with stochastic 
input t — > £t 



Take the T-periodic signal t — > S(t) of subsection 2.1 and suppose moreover that t — > S(t) is smooth. 
Consider a diffusion 

(6) d& = ( S(t) -it)rdt + 7 g(&) V^dWt 

for suitable q(-), where we have chosen a parametrization in terms of r (governing 'speed' of the 
diffusion) and 7 (governing 'spread' of one-dimensional marginals). We assume that the process 
(Ct)t>o takes values in an open interval U in M, that q(-) is strictly positive on U, and that in 
restriction to every compact interval in U, the function q(-) is of class C°°, bounded together with all 
derivatives. Then £ is a non time-homogenous diffusion which carries the signal S. We assume that 
q(-), t and 7 are such that strong solutions to ^ exist and such that the following holds: 



(VI): The grid chain (CfcT)^ is positive Harris with invariant law [i on U. 



The T-periodic structure of the semigroup of transition probabilities of (£t)t>o combined with (VI) 
implies, for arbitrary choice of a shift < s < T, that segment chains 

( £,{s+kT .s+(k+i)T] ) keNo are P osr tive Harris with invariant law on C([0,T]) denoted by . 
It also implies that, for every I G IN, ^-segment chains 

{^[ s +k(er) ,s+(k+i)(iT)] )fc g jv are positive Harris with invariant law on C([0,£T]) denoted by m^'^ . 

As a consequence, under (VI), trajectories of the process £ should in some sense get 'close' to the 
deterministic T-periodic signal t — > S(t) as t — > 00, for arbitrary choice of a starting point in U. 
In the next example we introduce two basic models that we have in mind: Cox-Intersoll-Ross and 
Ornstein-Uhlenbeck type T— periodic diffusions carrying the signal S. 
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Example 2 a) CIR type: for some constant K such that K > ^- + sup \S\, we take U = (—K,oo) 
and q(x) = y/(x + K) V for x & U. By choice of the constant K, the process £ will never attain 
-K. 

We have Laplace transforms for £t = £t + given £ s = x > 0, which have the form 

A -»• exp j-x* s , t (A) - ^ 5(v)*,, )t (A)rdv| , 



where 



re - T ('- s ) 



^ (A) = i + A¥(i-^-) ) -' <t - Ae[0, °° ) 

and S(v) = S(v) + K. Note that 

*tl,*2 ° ^Ws = **1,*3 0n [ > f° r < h < t 2 < t 3 < CO, 

and compare to the (time homogeneous) formulas (1.1) +(1.8), (1.12) +(1.13), (1.14) of Kawazu and 
Watanabe 1911. 

If we write jl for the invariant law of (£fcT)fceiVj T— periodicity of S allows to write the Laplace trans- 
form of fi as 

A — ► expj-y 5(v)* w>0 (A)rdv| . 
Similarly, the invariant law of (£fcT+s)fceiv for < s < T has Laplace transform 



A — »• expj-^ 5(v)* w>0 (A)rdv|. 



Taking derivatives in the last expression and noticing that (^*«,t)(0+) = e r ^ expectations of £ s 
starting at time t = /rom £o ~ A 

M(s) := £ A , (f s ) = /°° 5(« - -)e- r dr 

are T— periodic functions in s. 

b) OU type: we take U = M and q(-) = 1. T/ien we have an explicit representation 

£ t = xe' T ^ + j e-^-^ (TS{v)dv + ^dW v ) , t>s, 

for the process starting at time s in x. With the same function s — > M{s) = S(s — '^)e~ r dr as in 
a), the invariant law \x of (CfcT)fcew is 

M =A/-(M(0),^) 



and the law of £ s starting at time t = from £o ~ f- ^ s 
(cf. Hopfner and Kutoyants 2010, Ex. 2.3). 

Hence in both cases a) and b), the T— periodic signal S(-) is expressed in the process £ under 'period- 
ically invariant' regime in form of moving averages 



s -> E^ s ) = M(s) = [°° S(s - -)e~ r dr 

Jo T 



which are T— periodic. 



Consider now the HH equations driven by stochastic input d£t, i-e- the 5d system 

' dV t = d£ t -[g K n A t (V t - Ek) + 5 Na m 3 t h t {V t - E Na ) + g L (V t - E L )] dt 
dn t = [a n (V t ) (1 - rit) - (3 n (V t )n t ]dt 
(£1111) { dm = [a m {V t )(l-m t ) - f3 m (V t )m t ]dt 

dh t = [a h (V t )(l-h t ) - p h (V t )h t ]dt 
. dtt = (S(t)-St)rdt + iq{it)^dW t 
under assumption (VI). Write £5 = 1R x (0, l) 3 x U for the corresponding state space and denote 
its elements by (v,n,m, h, (). Let ( P sl>S2 (xi, dx 2 ) )o< Sl < S2 <oo denote the semigroup of transition 
probabilities (which is non-homogenous in time) of the 5d system (£HH). Due to T-periodicity of the 
deterministic signal t — > S(t), the semigroup is T-periodic in the following sense: 

(xi,dx 2 ) = P Sl +kT,s2+kT{xi,dx 2 ) for all k G -2V . 
2.3 Existence of densities for the stochastic HH system 



In order to state our first theorem we have to introduce some notation. Let us first denote the drift 
terms related to n, m, h in (HH) 

G n (v,n) = a n (v) (1 - n) - /3 n (v)n , g n (v,n) = a' n (v) (1 - n) - P' n (v)n, 
G m (v,m) = a m (v) (1 - m) - (3 m (v)m , g m (v, m) = a' m (v) (1 - m) - f3' m (v)m, 
G n (v,h) = a h (v)(l-h) - f3 h (v)h , g h (v,h) = a' h (v)(l-h) - f3' h (v) h , 

where notation ' is reserved for derivative with respect to v. Then let 



(7) 



D(v,n,m,h) := det 



( g'n g'n 9': ^ 



q' q" q'" 

i>m i>m Urn 



\9' h < € j 



(v,n,m,h) , (v,n,m, h) G £4 



This determinant will be important in the sequel. We introduce 



O := {(v, n, m, h) G E4 : D(v, n, m, h) / 0}. 



Notice that by continuity of D on E±, the set O is open. Moreover, \{O c ) = 0. This can be seen as 



follows. Firstly it can be shown numerically that O is not empty (see Section 2.4 below). Moreover, 
for any fixed v G M, the function (n, m, h) — > D(v, n, m, h) is a polynomial of degree three in the three 
variables n, m, h. In particular, for any fixed v, either D(v, ., ., .) vanishes identically on (0, l) 3 , or the 
zeros of (n,m,h) — > D(v,n,m, h) form a two-dimensional sub-manifold of (0, l) 3 . Finally, since the 
determinant is a sum of terms 

(some power series in v) ■ n £n m £m h £h 

with epsilons taking values or 1, it is impossible to have small open ^-intervals where D(v,.,.,.) 
vanishes identically on (0, l) 3 . Then integrating over v, Fubini finishes the proof. 

Now we have the following result. 



Theorem 1 The weak Hormander condition holds at points x = (v, n, m, h, (") in E§ whose first four 
components belong to O. 



We provide in Section 2.4 below a numerical study of the set O where the Hormander condition holds. 
Once the Hormander condition holds locally, we are able to show that the process, in spite of its very 
degenerate structure (only the first and the fifth variable carry Brownian noise), possesses Lebesgue 
densities locally. This is the content of the next theorem. 



Theorem 2 For < s\ < S2 < 00, consider the 5d process (£HH) starting at time s± > from 
arbitrary x £ E5. Then in restriction to the subset OxU of E^ , the law P SltS2 (x, ■) admits a continuous 
Lebesgue density p Sl ^ S2 (x, ■) . Moreover, for any fixed x' G O x U, the map x — > p sl)S2 {x,x') is lower 
semi- continuous. 



Note that this is a local result in the second variable for fixed starting point, local in restriction to 
O x U. In particular we impose the Hormander condition on the second variable and not on the starting 
point. 
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2.4 Numerical study of the determinant D 



We study numerically the above determinant ([7]) and provide some figures. First, we can not expect 
to have D(v, •, •) ^ on (0, l) 3 . Indeed, we find that D vanishes at points (v, n^^v), moo(v), hoo(v)) 
with v located at ~ —11.4796 and ~ +10.3444. Second, O is certainly non-empty since we find a 
strictly negative value of the determinant e.g. at the point (0, n^O), moo(0), /ioo(0)). 

In order to obtain more detailed information about O, we calculate the determinant D in stable 
equilibrium points and along stable orbits of (HH) corresponding to different constant inputs S(-) = c. 

First of all, we find that the function v — > D (v,n 00 (v),m 00 (v),h 00 (v)) has exactly two zeros on 
Iq := (—15, +30) which are located at v ~ —11.4796 and ~ +10.3444. Since the function F^^v) of 
Q is strictly increasing on a large interval containing Iq, all points (v, rioo(v), m,oo{v), hoo(v)) with 
v G Jq correspond to equilibrium points of (HH) associated to constant input c where -Foo(^) = c. 
The corresponding range of values for c is given by c G (F 00 (— 10), F oo (+10)) = (—6.15,26.61). For 
D~0we find c ~ 0.0534. Hence for all values of c belonging to (—6.15, 26.61), the determinant of the 
associated equilibrium point stays strictly negative. 

Moreover, also on stable orbits of (HH) with large enough constant signal, we can not expect that D 
never vanishes. Indeed (see Figure 1 below), on a good approximation to the stable orbit for constant 
signal S(-) = 15, we find numerically a segment requiring approximately one third of the time needed 
to run the orbit (very roughly, this segment starts when the variable v up-crosses the level —2 and 
ends when v up-crosses the level +5) where the determinant D(v,n,m,h) in ([7]) is negative and well 
separated from zero. On the remaining parts of the orbit, the determinant changes sign several times, 
and in particular takes values very close to zero immediately after 'the top of the spike', i.e. after the 
variable v has attained its maximum over the stable orbit. 

In Figure 2 below we consider a deterministic HH with constant input c = 15 starting in a numerical 
approximation to its equilibrium point. It is seen that this equilibrium point is unstable, and the 
system switches towards a stable orbit. In this picture, already the last four orbits can be superposed 
almost perfectly. Figure 1 shows the value of the determinant at equidistant time epochs on the last 
complete orbit (starting and ending when the membrane potential v up-crosses the level 0, and having 
its spike near time t = 180). 
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determinant on the stable (v,n,m,h)-orbit of deterministic HH 
with time-constant input c=15 as a function of time 




Figure 1: Determinant D of Q calculated on the stable orbit t — > (v t ,n t ,mt, h t ) of the deterministic system 
(HH) with constant input c = 15. The time needed to run the stable orbit is « 12.56 ms. 



deterministic HH with constant input c=1 5 starting at its equilibrium point: V function of t, 
initial conditions v such that c=F_infty(v), n=n_infty(v), m=m_infty(v), h=h_infty(v) 




50 100 150 200 

[ms] 



initial conditions as above: n, m, h functions of t 




50 100 150 

[ms] 



Figure 2: Deterministic HH with constant input c = 15. 
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2.5 The HH system with stochastic input can reproduce any deterministic feature 



In our Theorem [2j no condition is imposed on the starting point, and the density might be identically 
on O x U. In order to exhibit regions of the space where the transition density is strictly positive we 
use control arguments. These arguments are interesting also for the following reason. They show that 
the stochastic system (£HH) is able to reproduce any possible deterministic spiking behavior during 
any arbitrary long period, in the sense that any of these behaviors is in the support of the law of the 
process. In other words, the stochastic system (£HH) driven by the signal S can stay with positive 
probability for an arbitrarily long time in arbitrarily small tubes around deterministic solutions of 
systems (HH) driven by any smooth T-periodic signal. 

During this subsection, we still denote t — > S(t) the fixed T— periodic signal which is carried by the 
diffusion process and which governs the evolution of (£HH). Moreover, t —> S(t) will denote any 
other signal chosen independently of S. We shall write Po,x for the law of the process (£HH) starting 
from x G E$ at time 0. 

Theorem 3 Fix (v, n, m, h) G E4 and t > 0. Then for any smooth T— periodic signal s — > S(s) and 
any initial value £ G U such that J s := C + Jq S(u)du G U for all s < t, the following holds: 

Let X s ,s < t, be the associated deterministic system (HH), driven by the signal s — > S(s). Write 
x = (v, n, m, h, (). Then we have for any e > 0, 



0,2 



/ G C([0, oo[, M 5 ) : sup \f(s) - X,\ < e } ) > 0. 

s<t 



Moreover, for any fixed e > 0, there exists 5 > 0, such that for all x" G Bs(x), 

IV" N / € C([0, oo[, M 5 ) : sup 1/00 -X s | < ej^j > 0. 

We sketch two situations where the above theorem can be applied successfully. Consider first the 
situation of constant signal S = c. In what follows, B £ (x) denotes the open ball of radius e centered 
in x. Moreover, for a suitable choice of c, let v c be such Foo^c) = c. 

Corollary 1 Fix a constant c such that v c exists and let £ G U such that J s = £ + cs G U for all 
s < t. Then for all £ > 0, 

P ,t(x c ,B £ {x' c )) >0, 

where 

x c = (f c ,n 00 (t! c ),m 00 (t> c ),/i 00 (r; c ),C), x' c = (v c , 7ioo(u c ), rnoo(v c ), hoo(v c ), ( + ct). 
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Moreover, for any fixed e > 0, there exists 5 > 0, such that for all x" G B$(x c ) 



P , t (x",B £ (x' c ))>0. 



Now we combine this result with Theorem [2] above and use the fact that Hormanders condition holds 
for several stability points (cf. Section [2.4| above) . We keep the notation of Corollary [TJ 

Corollary 2 For any c such that v c exists and such that the local Hormander condition holds at x c , 
there exists 5 > such that for K c = Bs(x c ) and K' c = Bs(x' c ), 



The above result holds in particular for —6.15 < c < 26.61. 

The second situation which we consider is the deterministic system (HH) with sinusoidal signal 



hara, Matsumoto and Ikegaya 1984 for a modified system, for the (HH) system as above see Endler 
2012 Ch. 2.2). There are specified subsets D%, D%, D3, D4 in (0, 00) x (0, 00) with the following 
properties: i) for (a,T) in D\, the system (HH) is periodic with small oscillations which can not be 
interpreted as 'spiking'; ii) for (a, T) in D2, the system moves on a T-periodic orbit, and the projection 
t — > Vt resembles the membrane potential of a regularly spiking neuron (single spikes or spike bursts 
per orbit); hi) for (a,T) in D3, the system moves on a feT-periodic orbit for some multiple k £ IV; iv) 
for (a, T) in D4, the system behaves 'irregularly' and does not exhibit periodic behavior. 

Corollary 3 Let (a,T) 6 D2 and (0, n*, m*, h*) be a point on the T— periodic orbit of the associated 
deterministic system (HH) such that 



Fix C G U such that ( + f° S(u)du £ U for all < s < T and write x* = (0,n*,m*,h*,Q and 
z* = (0,n* ,m* ,h* ,(+ Jq S(u)du). Then there exists 5 > such that for K = Bs(x*) and K' = Bg(z*), 



inf inf pr\ t (x,x') > 0. 
xeK c x'EK' c ' 




some constant. This system presents additional features (see Ai- 



(8) 



(0,n*,m*,h*) G O. 



inf inf pqt(x,x')>0. 



The proofs of Theorem [TJ Theorem [2] and Theorem [3] are given in Sections [5| [4] and [6| respectively. 
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3 Discussing T— periodic ergodicity of the stochastic (HH) system 



Using Lyapunov functions, one can show that the five dimensional diffusion process X of (£HH) is 
ultimately bounded (cf. Miyahara 1972). As a consequence, the grid chain (Xkr)k possesses (possibly 
infinitely many) invariant probability measures. 

Suppose there exists some orbit and an associated recurrent point x* as in Corollary [3] above such that, 
for all starting points, the grid chain visits K = Bg(x*) infinitely often. Then Corollary [3] implies the 
Harris property of the grid chain, and hence T— periodic ergodicity of the stochastic Hodgkin-Huxley 
model (compare to Hopfner and Locherbach 2011), the sets Bg(x*) playing the role of 'small' sets of 
the system. 

Hence Corollaries [2] and [3] above are important steps towards periodic ergodicity of the process. 
However, in order to show the recurrence property of one of these sets K, one has to find a Lyapunov 
function which forces the system to come back precisely to this set K. This requires a more detailed 
study of the recurrence properties of the process and of the possible sets K and will be part of some 
future work. 

4 Smoothness of densities of a strongly degenerate inhomogeneous 
SDE with locally smooth coefficients: proof of Theorem [2] 

Let Xt = (Vt,nt,mt, ht,£t) be the 5— dimensional diffusion process of (£HH). The aim of this section 
is to show that this process admits locally a continuous Lebesgue density. Classically, the main tool 
to prove that the law of a diffusion admits a smooth density is Malliavin calculus. A usual technical 
condition is to suppose that the coefficients of the SDE are bounded C°°— functions with bounded 
derivatives of any order. This condition is obviously not satisfied in our situation. Moreover, in our 
case, a one-dimensional Brownian motion is driving a 5-dimensional system; as we will see in Section 
[5j the Hormander condition holds only locally. Finally, the drift coefficient depends on time. 

Therefore we have to apply local results which are similar to those obtained by Kusuoka and Stroock 
1985. The results obtained there hold only in a time homogeneous frame. So in what follows we 
extend the results of Kusuoka and Stroock to the non time homogeneous case. In order to do so, we 
recall ideas of De Marco 2011 and adopt them to our frame. The results we obtain are interesting in 
their own right, therefore we state them in a general setting. 

We start by introducing some notation and the general framework in which we will work. 
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4.1 Notation 



Let m > 1. We consider processes taking values in ]R m and write x = (ar, . . . , x m ) for generic elements 
of M m . We will identify the time variable t with x°. Let a be a measurable function from M m to M m 
and 6 a a smooth function from [0,oo[xiR m to M m . For yo £ an d S > we denote by B§(yo) 
the open ball of radius 5 centered in yQ. For any open subset A C iR m , C^°(t4) denotes the class of 
infinitely differentiable functions defined on A which are bounded together with all partial derivatives 
of any order. Fix some < R < 1. We consider the SDE 

(9) Xl = x { + I b i (s,X s )ds+ [ a i {X s )dW s , t>0, i = l,...,m, 

Jo Jo 

for all x G M m . Here, W is a one-dimensional Brownian motion and a : M m —> M m is identified with 
an m x lmatrix. 

We impose the following conditions on the coefficients of the above equation. 

(HI) Existence of strong solutions holds for the couple (b(t,x),a(x)) . 

Let then (X t ,t > 0) be a strong solution of Q. We suppose moreover that there exists a growing 
sequence of compacts K n = [a n , b n ] C M m , K n C K n+ i, such that the following holds. If the starting 
point x satisfies x £ \J n K n , then we have 

T n := inf{i : Xt ^ K n } — > oo almost surely as n — > oo. 

In the above, [a n ,b n ] = Y\™=i Kj^Ii where a n = (a„, . . . ,a™). Due to the above condition, we can 
introduce 

(10) E = {]K n , 

n 

which is the state space of the process. 

We impose local smoothness on each compact K n . For that sake, fix some T > and suppose: For all 
n, for all multi-indices j3, we have 

(H2) a € C£°(K n , M m ), b(t, x) + dpb(t, x) is bounded on [0, T] x K n , 

where for (3 € {0, ... , m} 1 , 1 > 1, dp = q^^ q^ ■ Recall that we identify x° with t. 
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4.2 Hormander condition 



Due to the strong degeneracy of our biological system (£HH) , the condition of ellipticity is no where 
satisfied. However, as we will see in Section [5] below, the Hormander condition holds locally. In order 
to state the Hormander condition, we have to rewrite the above equation ^ in the Stratonovitch 
sense. That means, we replace the drift function b(t, x) by b(t, x) defined as 

1 m do 1 
b\t,x) = b\t,x) - - ^a k (x) — {x), xeE, \ <i<m. 

k=l X 

The above drift function is non-homogeneous in time. The associated directional derivative is 

Notice that Vq can be identified with the (m + 1)— dimensional function Vo(t, x) = (1, ft 1 , . . . , b m ). 

By convention, all other functions V(t,x) : [0,oo[xJR m — > JR m different from Vo will be interpreted 

only as directional derivatives with respect to space variables 

m P) 
V{t,x) = Y,V%x)— v 

i=i 

even if they are time dependent. Hence we identify V(t,x) with the (m + 1)— dimensional function 
V(t,x) = (0,V\...,V m ). 

Now we can introduce the successive Lie brackets. We start by putting V\{x) = cr(x) and identify this 
function with the directional derivative Y17=i ^i ( X )^ T = S£i cr *( x )^T- 

We adopt the formalism of Kusuoka and Stroock 1985 and put A = U USi({0> 1}) ■ ^ or an y &■ £ A, 
define \a\ := I if a G {0, l} 1 , 1 > 1, |0| = 0. Moreover, let ||0|| = and ||q|| = \a\ + card{j : aj = 0}, if 
\a\ > 1. Finally, we put a' = (ax, . . . , oti-i) if a = (ai, . . . , ai), I > 2, a' = if I = 1. 

Recall that Vb = + b = g|o + & an d that V\ = a. For any V : [0, oo[x M m M m , define inductively 
in \a\, 

V 9 (t,x) :=V(t,x) 

and for \a\ > 1, 

(11) V( Q) (t,x):=[K n V)]- 
Here, [V, W] denotes the Lie bracket defined by 

3=0 V 7 
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In other words, if V = V\ = <r, we have 

3=1 V 7 

and the time variable does not play any role. But if V = Vq, we have, since Vq = 1, 

3=0 V 7 j=l V 7 

Finally, for any x £ E and any 77 G M m , we define 

V i (t,a: ) T7)= < (Vi\ a) (t,x),ri > 2 

a:\\a\\<L—l 

and 

(12) V L {x)= inf V L (t s a:,»7)Al. 

0<t<T,rj:||?7|[=l 

We assume: 

Assumption 1 There exists yo with B^^(yo) C E and some L > 1 suc/i i/ia£ i/ie following local 
Hormander condition holds: 

(H3) We V L (y) > c(y , R) > /or y G B 3K (yo)- 

Now our result is as follows. 

Theorem 4 Assume (HI), (H2) and (H3). Then for any initial condition x G E and for any t < T, 

the random variable Xf admits a Lebesgue density Pot( x i y) on ^r(Vo) which is continuous with respect 
to y G Bji(yo). Moreover, for any fixed y G Br(jjq), E 3 x — > Po t t(x, y) is lower semi- continuous. 

The proof of Theorem [4] is given in the next subsection and uses localization arguments. 
4.3 Proof of Theorem [4] 

Recall that a random vector taking values in M m is said to admit a density on an open set O C M m if 

E(f(X)) = J f(x)p(x)dx, 
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for any continuous function / G Cb(M m ) such that supp(f) C O, for some positive function p G L 1 (0). 
We rely on the following classical criterion for smoothness of laws which is based on a Fourier transform 
method. 

4.3 Proposition: Let v be a probability law on M m and let be its Fourier transform. If u is 
integrable, then v is absolutely continuous and 

p(y) = / e-^^K 



(27T) 

is a continuous version of its density. 

We have to replace the above argument by a localized one. This localization follows ideas that have 
been developed by De Marco 2011 and that we adopt to our frame. We start by taking a function 
$ G C^{M m ) such that 1 Br (o) < $ < 1b 2H (o)- Fix & and f < T and suppose that E x ($(X t - y )) := 
rriQ > 0. Then we can define a probability measure v via 

(13) / f(yHdy) := —E x (f(X t )<f>(X t - y )) . 

J mo 

In order to prove Theorem [4] it is sufficient to show that v admits a continuous Lebesgue density. For 
that sake let 

m = — E x (e l <^>$(X t -y )) 

be its Fourier transform. All we have to show is that is integrable. In order to do so, we use 
Malliavin calculus localized around y§. More precisely, we localize the coefficients of the SDE ^ in 
the following way. Let ip £ C^°(M m ) such that 



y if |y| < 4R 

5Rf^ if \y\ > 5R 
\y\ iyi - 



and IV'Cy)! — 5i? for all y. Put b(y) = b(ip(y — yo)) and a(y) = cr(if)(y — yo)). Then by condition (H2), 
b and a are C£° -extensions of ^£4^0) and o\ BiR (y y 

We denote X the unique strong solution of the equation 

(14) X i s = x i + I b\u,X u )du + / a^XuidWu, u < T, 1 < i < m. 

Jo Jo 

Up to the first exit time of Bm(yo), both processes X and X coincide. 
Now for some fixed 5 G]0, t/2 A 1[, we put 

t\ = inf{s > t - 5 : X s G B 3R (y )} and r 2 = inf{s > t\ : X s £ B 4R (y )}. 

19 



Then, 

{H>(X t - y ) > 0} = {<S>(X t -y )>0;t-S = T 1 <t<T 2 } 



U { $(X t - y ) > 0; sup \X S {X T1 ) - X T1 \ > R 

0<s<8 



Hence, 



(15) m z>(£) = E x (e^^^Xt - y ) 

= E x {e l< ^ Xt> ^{X t - yo)l$(X t - 2/0 )>0;sup < s < 6 \X a (X Tl )-X Tl \>R y 

+ E x (e L< t< Xt> ${X t - yo)l^X t -y )>0;t-5= T1 <t<r 2 ) 

The first term can be controlled, for all q > 0, as follows. 

(16) P x ($(X t -yo) > 0; sup \X s (X n ) - X n \ > R j < C(T,q,m,b,a)R~< 1 5 q / 2 . 

\ 0<s<8 J 

Here we have used the following classical estimate: For all < s < t < T, 

(17) e( sup \X l r -Xi\ q ) < C(T,q,m, b, a){t - s) q/2 . 

\r:s<r<t J 



The above estimation in (16) holds uniformly in x. The constant C(T,q,m,b,a) depends on the 



supremum norms of b and a, hence, by construction, on the supremum norms of b and a on B^n{yo). 
The important contribution comes from the second term which can be controlled as follows. 



(18) E x (e i< ^ > ^(X t -y )H { x t -y ) > o- > t-5=r 1 <t<r 2 ) < sup \E (e l< ^ X ^> ^(X 5 {y) 
v ' yeB 3R ( yo ) v 



2/o, 



Here, we have used the Markov property with respect to the time t — 5. Again this control holds 



uniformly in x. To the last term in (18) we apply the integration by parts formula of Malliavin's 



calculus. We derive two times with respect to each space variable, i.e. we define the multi-index 

P = (1,1,2, 2,. ..,m,m). 

Then, since d Xk e l< ^ x> = i^ k e iK ^ x> , 



\E^<^y>^(Xs(y)-yo))\< 



j-pn^p l^ (d^<My>^(X s (y) - y )) | < 

1 



UT=i ieT 
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E(\Hp(X s (y)MXs(y)-yo) 



The last inequality follows from the integration by parts formula of Malliavin's calculus, and Hp is 
the weight appearing in this formula, see e.g. Proposition 2.1 of De Marco 2011. We have \ j3\ = 2m. 
Recall that L is the number of brackets needed in order to span M m in yo, see condition (H3). We 
will show in the appendix that the following classical result holds. There exists a constant ni such 
that 



(19) 



\H^X s (y),^(X s (y)-y )\\ P < C(T,p,R,m)5- 



mriL 



We deduce from (16) and (19) that, for any q>l, 

m u(0 < C(T, q, R, m) R- q 5 q/2 



-mn L 



The following argument is the main idea of balance that is given in De Marco 2011: We choose for a 
given £ a value of 5 ensuring that R~ q 5 q l 2 + j-^m 1 ^i^ 5~ mnL tends to zero faster than (n2=i ■ 
Let ||f || := If I and choose 



With this choice we have 
(20) 



5 = t/2 A 1 A ||£|| 2mn L , q = Qmn L . 



moHO<C(T,q,R,m) U\\^: 



and this is integrable in £ for ||£|| — > oo. 



Now we can conclude the proof of Theorem |4j Recall the definition of v in (13). Then for any 

y e B R (y ), 

(21) m (x, y) = j^- [ e- l <^>u(m = T^w / e-^E^'^iXt - y ))d^. 

We cut the above integral into the integral over a finite region / where ||£|| < C and its complementary. 
On /, we can upper bound the integrand by 1 (recall that $ < l_B 2i j(o))> and on I c , we use the above 



upper bound (20). This proves the continuity of pot(%, y) with respect to y. Note that this continuity 



is uniform in x, since the upper bounds obtained in (|16J) and (18) do not depend on the starting point 
x. 

It remains to prove the lower semi-continuity of Po t t(x,y) in x £ E, for fixed y G Bn{yo). The idea 
is to compare the diffusion X to an approximation X n , which is obtained when considering X before 
the first exit time of K n , for some fixed compact K n . It is then natural to use the flow property of X n 
which implies continuous dependence on the starting point. (Notice that the process X itself might 
not satisfy the flow property.) 
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For that sake, fix n and let b n (t,x) and a"(x) be C£°— extensions (in x) of b(t, -\K n ) an d &\K n - Let 
X n be the associated diffusion process. X coincides with X n up to the first exit time T n . Hence, for 
x € K n , we can write 



E x (e^ x t><S>(X t - m )) = Yi^E x {e^ x ?><S>(X? -y )l {Tn>t] 

> E x U<> X ?><S>(X?-y Q )l {Tn>t} 



Here, the first equality follows from T n — > oo almost surely as n — > oo. The inequality follows from the 
fact that Xp = X t on {T n > t}. The last expression E x (e i<?,x " > <I>(Xf - yo)l{T n >t}) would depend 
continuously on x, due to the Feller property of X n , if there would not be the presence of the indicator 
of {T n > t}. We have to approach the above indicator function by some continuous operation on the 
space of continuous functions. To be more precise, let f2 = C(]R + ,lR m ). We endow Q, with the topology 
of uniform convergence on compacts and write Pq x for the law of X n on (fl,B(fl)), starting from x 
at time 0. Then we know that the family of associated probability measures {Pq , x S JR m } is Feller, 
i.e. if Xfc — > x, then ^q x , — > ^ weakly as k — > oo. 

What follows is only devoted to replace the indicator of {T n > t} by some continuous functional on 
O. Let M" = max s <( X™ and m™ = min s <i X™ be the (coordinate-wise) maximum and minimum 
processes associated to X n . Due to the structure of the compacts K n , we can construct C£°— functions 
(p n , $ n such that l[ an _ 1)00 [ < W n < l [a n ,oo[ and l]_ 0O ,6„_ 1 ] < $ n < l]-oo,6 n ] (these inequalities have to 
be understood coordinate- wise). Then, since Xt equals X™ up to time T n , 

{T n -i >t} = {a n _x < m n t < M? < b n ^} C > 0, $™(M") > 0} C {T n > t}. 

So 

E x (^^"^(Xf - 2/o)1 { t„>*}) > E x (e i ^>*(A? - ^"(M^K")) , 
for any n. Write 

7 „(s,0 := — (e i <W>$(X t n - yo)* n (M?)<p n (m?j) . 

mo \ J 

By the Feller property of Pq and since all operations appearing in 7 n (^, £) are continuous operations 
on f2, 7n( - ,C) is continuous in x, for any fixed n. Now, instead of applying Malliavin calculus to 



E x (e l< ^' Xt> <&{X t — yo)) as we did in (15) above, we apply the above estimates to ^y n (-,0- Note that 



the upper bounds (16), (18) and (20) hold also for mo7n (£,£)• Moreover, they hold uniformly in x. 



This implies, by dominated convergence, that for any y £ Bn(yo), 

\ Z7T ) JM m 
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is continuous in x. Finally, we have that 

Po,t{x,y) = limtPo j4 (x,y). 

This implies the result, since the limit of a growing sequence of continuous functions is lower semi- 
continuous, and finishes the proof of Theorem |4j □ 



4.4 Theorem [4] implies Theorem [2] 

We check conditions (HI), (H2) and (H3) for (£HH). Condition (H3) is satisfied once Theorem[T] 
is proved. 

We now show that condition (HI) is satisfied. By our assumptions, a strong solution of ^ exists. 
Moreover, the coefficients of V and n, m, h are locally Lipschitz continuous. This implies the existence 
of a unique strong solution of (£HH) which is a maximal solution, i.e. exists up to some explosion 
time. So all we have to do is to prove that the process does not explode. By assumption, £ 4 does not 
explode. Consider now the unique solution (Vt,n t ,mt,h t ,^t) of (£HH) on [0, T^l, where is the 
associated explosion time. We show first that n,m and h stay in (0, 1), whenever they start in (0, 1). 
The result is a consequence of the common structure of the equations satisfied by n, m, h. The details 
are given for n but the same arguments apply to m and h. We fix u and rewrite 

dn t = (a n (V t )(l - n t ) - f3 n (V t )n t )dt 
= -(a n + p n )(Vt)ntdt + a n (V t )dt 
= [-a(Vt)n t + b(Vt)]dt, 

where a(v) = (a n + j3 n ){v) and b(v) = a n (v). Given the fixed trajectory V t on [0,Too[, the variation of 
constants method yields the following representation of nt : 

(22) nt = n e~ /o a ( v ^ ds + f b(V u )e~ St a ^ dr du, t<T 00 . 

Jo 

Notice that the above equation does not provide an explicit formula for nt, since V depends on n. 

We rewrite /„* b{V u )e~ Si a ( v -) dr du = f* ^|a(K)e - ^ a(Vr)dr du. By definition, a{v) is positive and 
[0,1). Hence 

(23) < nt < n e" So + f a(K)e" Si a ( y r) dr du. 

Jo 
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In the above formula, the strict positivity of nt follows from the fact that Jq a(V s )ds + J* * b(V s )ds < oo, 
since t < T^. By integration by parts it follows that 



(24) 



< nt < (n + e^o < v r) dr - l) e ~ So a ( v ^ ds 
= 1 + (n - l)e~ So a ( v ^ ds . 



Therefore if no G (0, 1), then for all t < Too, nt G (0, 1). The same kind of arguments apply to m and 
to h. 

As a consequence, we deduce immediately from (£HH) that for suitable constants C\ and C2, 

\V t \ < \Ct\ + Ci f \V a \ds + C 2 t, t < T^. 
Jo 

This implies, using Gronwall's inequality and non explosion of that Vj does not explode neither. 
Hence Too = 00 almost surely and the above estimates hold on [0, oo[. 

Now, let C n C C n +i C 1R be a growing sequence of compact intervals such that [JC n = U. Put 

1 1. 



-n,n] x [-,1 f x C n , 

n n 



then T n = inf{t : Xt G iiC^} — > 00 as n — > 00. Moreover, clearly (H2) is satisfied on K n . Therefore, all 
conditions needed in order to apply Theorem [4] are satisfied, and thus Theorem [2] follows. 

5 Proof of Theorem 1. 



Let Xt = (Vt,nt,mt,ht,(,t) be the 5— dimensional diffusion process of (£HH). Write 



b(t,x) 



( b l {t,x) \ 



\ b 5 (t,x) j 



G M 5 and a(x) 



( a\x) \ 



G M 5 , x = (v, n, m, h, () G E§, 



for its drift function and its diffusion coefficient. Here, 



Moreover, writing 



(25) 



b l (t,x) = (S{t)-QT-F(v,n,m,h), b 5 (t,x) = (S(t) - ()t, 
b 2 (t,x) = G n (v,n), b 3 (t,x) = G m (v,m), b 4 (t, x) = G h (v, h). 

d(C) ■= 7^9(0. 
24 



we have <r 1 (a;) = a 5 (x) = d(Q and a 2 (x) = a 3 (x) = a 4 (x) = 0. Hence (£HH) can be rewritten as five 
dimensional diffusion equation 

dX t = b(t,X t )dt + a(X t )dW t . 

As before, we rewrite this equation in the Stratonovitch sense and introduce b(t,x), where b l (t,x) = 
b l (t, x), for i = 2, 3, 4, and 



(26) 



b%x) = b%x)-±d!(0d(Q,i = l,5. 



Since this drift is time dependent, the associated directional derivative is 

Wt+ b\t,x)- + ... + b\t, X )-. 

We start by calculating the Lie-bracket of a and 6. In order to simplify notation, we identify the vector 
x = (v, n, m, h, Q with x = (x 1 , . . . , x 5 ). Then 



[b,a] 



da 1 

~dt 



n da 1 



<db l 



dx 3 dx 3 



c?K)i 5 (t,x)(fa + &)-<((c) 



j'=i 

9C 



,• da 1 s db 



dx 3 dx 3 



As a consequence, we get 



/ - T -±[(d'(0) 2 + d(Od"(0]-d v F(v,n,m,h) \ ( d'(()b 5 (t,x) \ 



[b,a] = -d(C) 



= d(C) 



V 

^ d v F(v, n, m, h) ^ 
-9n{v,n) 
-g m (v,m) 
~9h(v,h) 




9n{v,n) 
g m (v,m) 
9h(v,h) 

■t-1W j + W(0] 



+ 



o 
o 
o 

£5/ 



V cz'(c)6 5 (t,x) y 



where 







V 1 / 

1, 



A 2 (t, C) := d'(()b 5 (t, x) + d(C)[r + -[(d'(C)) 2 + d(C)d"(C)]]- 



Write V2 = [6, <r]. We are now going to evaluate V3 = [a, V2]. We have 



[f,V'2]' 



E(4I-^°«> 



.da 1 
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Therefore, 



V 3 (t,x) = d 2 (() 



^ d%F(v, n, m, h) ^ 
-9n(v,n) 
-g' m (v,m) 
-9' h (v,h) 




' d v F(v, n, m, h) ^ 



+ d(()d'(0 



\ 



-9n{v,n) 
-g m (v,m) 
-9h(v,h) 




+ A 3 (t,C) 







V 1 J 



where 



A 3 (t, C) := d(Qd C A 2 (t, C) - A 2 (t, CMC). 
Putting V& = [a, V 3 ] , we obtain analogously that 



^ d%F(v, n, m, h) ^ 
-9n{v,n) 



= d 3 (() 



-9m(v,m) 



-9H(v,h) 




+ (3d 2 (cK(0) 



+ (d'(cf + d(C)d"(0) 



^ d%F(v, n, m, h) ^ 

-9' h (v,h) 


^ d v F(v, n, m, h) ^ 
-9n(v,n) 
-g m (v,m 
-9h(v,h) 




/ 



\ 



+ Ai(t,c) 







V 1 / 



where 



A 4 (t, C) = d(()d ( A 3 (t, C) - A 3 (t, C)d'(C). 
Finally, for V5 = [<r, V4], we obtain similarly a representation 
^ d%F(v, n, m, h) ^ 



^5 = d 4 (C) 



V 



-g'"(v,m) 



-9'H{v,h) 




+ ai(C)Bi + a 2 (C)S 2 + a 3 (C)5 3 + A 5 (t, Q 



J 



( l\ 





V 1 / 



where a\ , a 2 , a 3 are functions defined in terms of derivatives of d and where B\,B 2 ,B 3 G 
Span{V 2 ,V 3 ,Vi}. 

Now we are able to conclude our proof. Since by definition of F in Q, d v F(v,n,m, h) 7^ for all 
(v, n, m, h) G E± and d%F(v, n, m, h) = for all k > 2, we have for all fixed 2 G £"5, 

Span{a, V2, T^, ^4, V5} = Spar^ei, e 5 ,gi,g 2 , g 3 }, 
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where 







\ 



dlg n (v,n) 
■I i ~ d l v g m (v,m) 
dlg h (v,h) 

V J 

By the definition of D(v, n, m, h) in (j7|), these five vectors a, V2, V3, V4 and V5 span iR 5 for all x G es 
such that D(f , n, m, /i) 7^ 0. This concludes the proof. □ 



6 Proof of Theorem 3. 



With all notations of Theorem 3, we consider the system (£HH) driven by S of Section 2.2 

(27) X s = x+ a{X u )dW u + b(u,X u )du, s<t. 

Jo Jo 

We write f2 = C([0, 00 [, if? 5 ) and endow with its canonical filtration (J-t)t>o- Let Po,x be the law 
of (X u ,u > 0), starting from x. In order to find lower bounds for quantities of the form ¥q jX (B) 
for measurable B 6 Ji, we will use control arguments and the support theorem for diffusions. We 
need first to localize the system. Let C n C C n +i C U be a sequence of compact intervals such that 
[]C n = U. Put K n = [-n, n) X [-, 1 - x C n C E 5 and let T n = ia£{t : X t G K%} be the exit time 
of K n . For a fixed n, let b n (t,x) and <r n (j;) be C£°— extensions in x of b(t, -\K n ) and C|^- n . Let X n be 
the associated diffusion process. Then for any starting point x £ K n , we write Pq^ for the law of 
(X™, u > 0) on 0. Fix a time t > 0. Then for any measurable -B G J 7 *, 

(28) Pq^(B) > P ,x({/ G B; T n > t}) = P^.({/ €B;T n > t}). 

It suffices to show that this last expression is strictly positive, for suitable choices of x G K n and 
B. For this sake, as already mentioned, we will use the support theorem for diffusions, see Stroock 
and Varadhan 1972. Let H = {h : [0,t] ->• M : h(s) = j Q s h(u)du,Vs < t,f*h 2 (u)du < 00} be the 
Cameron-Martin space. Given h G H, consider X(h) the solution of the differential equation 



(29) X(h) s = x+ a n (X{h) u )h{u)du+ b n {u,X(h) u )du, s<t, 

Jo Jo 

where in accordance with the notation used previously in the paper, X(h) is 5— dimensional of the 



form X(h) = {X (h) 1 , X (h) 2 , X (h) 3 , X (h) 4 , S (h)) . In the above formula ([29], b n is the drift vector of 
X n , written in Stratonovitch form. 
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As a consequence of the support theorem for diffusions (see e.g. Theorem 3.5 of Millet and Sanz- 
Sole 1994 or Theorem 4 of Ben Arous, Gradinaru and Ledoux 1994), the support of the law Pq x in 
restriction to T% is the closure of the set {X(h) : h G %} with respect to the uniform norm on [0, t]. 



In order to find lower bounds for (28) we have to construct solutions X(h) of (29) which stay in K,, 



during [0, t]. But on K n , both processes X n and X have the same coefficients. Hence, in restriction to 



K n , the above control problem (29) is equivalent to the following, where we recall that d(.) has been 



defined in (25 ). 



(HHcontrolled) 



£x(h)l = £s(h) s -F(x(h)l,x(h)lx(h)lx(h)i) 

fX{hf s = a n (X(h)l)(l-X(h) 2 s ) - (3 n (X(h)l)X(h) 2 s 

X(h) 3 s = a m {X{h)l){l-X(hf s ) - m (X(h)l)X(h) 3 s 

X(h)i = a h (X(h)l)(l-X(h)i) - p h (X(h)l)X(h)i 



d S(h) s = (S(s)-S(h) s )T-U'(S{h) s )d(S(h) s ) + 7 q(S{h) s )y/¥h(s) 



In order to find simple solutions of the above system, we consider the specific starting point x 
which is prescribed in Theorem [3j Since C G U and (v,n,m,h) £ £4, there exists n such that 
x = (v, n, m, h, G K n . 

We will use x as starting point and construct solutions of (HHcontrolled) such that 

d 



(30) 



ds 



S{h) s = S(s), for all s < t. 



Equation (30) implies that S(h) s = S(h)o + J* Q S S(u)du = C + Jo S(u)du =: I s , for all s < t. Hence, if 
we define 

; M S(s) + (I s -S(s))r + ld'(I s )d(I s ) 
h{s) := — , s < t, 



then the right hand side of the last line of (HHcontrolled) equals indeed S(s). 

Notice that h is well-defined since g(/ s ) > for all s < t. Moreover, the signals S and 5 be- 
ing T— periodic, clearly h G L 2 ([0,t]), hence h G Ti. With this choice of h, the first four lines of 
(HHcontrolled) reduce to the deterministic system (HH) with input signal s — > S{s). Write Y for the 
associated deterministic solution starting from (v , n, m, h) at time and X s = (Y s , I s ), s < t. Then for 
n sufficiently large, X s G K n for all s < t. 



By the support theorem, for every e > 0, putting B^(K) = {/ G : sup s<t \f(s) 
that 

PoU(#f (x)) > 0. 



< e}, we have 
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Now choosing e such that Bf(X) C {/ G O : T n (/) > i} and putting B = B™(X), we obtain the 
desired first result of Theorem |3j Finally, by the Feller property of Pq x , for fixed e, we can extend the 
above property to a small ball around x. This shows the second assertion of Theorem [3j □ 



7 Appendix : Some elements of Malliavin calculus 

In this appendix we give the basic arguments from Malliavin calculus that allow to show that the 



important estimate (19) holds true in the non time homogeneous case as well as in the time homoge- 
neous case. For the basic concepts of Malliavin calculus, we refer the reader to the classical reference 
Nualart 1995. 



Throughout this section, X denotes the unique strong solution of the SED (recall also (14)) 

(31) X\ = x i + I &*(«, X s )ds + I a i (X s )dW s ,t < T, 1 < i < m, 

Jo Jo 

where x G M m , o l G C£°(lR m ), and where b l (t,x) and all partial derivatives d^d^b l {t, ■) are bounded 
uniformly in t G [0, T]. Let 

= 1 m r)rr l 

b%x) = b%x) -2E^Wr W ' 1 - * - m ' 

k=l Xk 

and Vq = §i + b be the associated time-space directional derivative. We use analogous notation to 
und put V\ = a. The local Hormander condition for a point x and a given number of 



section 



4.2 



brackets L is 

(H L )(x) V L (x) > 0, 



where Vl(x) is defined analogously to (12). 



The main ingredient for the control of the weight in Malliavin's integration by parts formula as in 



formula ( 19 ) is to obtain estimates of Malliavin's covariance matrix. We check that all results obtained 



in Kusuoka- Stroock 1985 are still valid in our framework. Let 

dX l 

{Yt)i,j = ~q^i 1 <hJ < m - 

Then Y satisfies the following linear equation having bounded coefficients (bounded with respect to 
time and space) 

Y t = I m + f db{s, X s )Y s ds + f da{X s )Y s dW s . 
Jo Jo 
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Here I m is the m x m— unity matrix and db and da are the m x m— matrices having components 
(db)ij(t,x) = ^r:(t,x) and (da)ij(x) = ff-(^)- By means of Ito's formula, one shows that Y t is 
invertible. The inverse Zt still satisfies a linear equation with coefhcients bounded in t and in x given 
by 

(32) Z t = I m - f dl{s,X s )Z s ds- [ da(X s )Z s odW s , 

Jo Jo 

where odW s denotes the Stratonovitch integral. In this framework, the following estimates are classical 
(see e.g. Kusuoka and Stroock 1985 or De Marco 2011, Prop. 2.2 and Lemma 2.1). For all < s < 
t < T, for allp> 1, 

(33) E[ sup \Xl -X l s \ p ) < C(T,p,m,b,a)(t- s) p/2 , 

\r:s<r<t J 



(34) sup E(\(Z.)ij\ p ) < C(T,p,m,b,a), l<i,j<m, 

s<t 



(35) sup E (\D ru ... <rk X l t \ p ) < C(T,p, m, k, b, a) U 1 ' 2 + l) P , 

where the constants depend only on the bounds of the derivatives with respect to space of b and a. 
Notice that the above estimates are not sharp, and much better estimates can be obtained, see for 
instance in De Marco 2011. However, for our purpose, the above estimates are completely sufficient. 



As indicated before, the main issue in order to prove (19) is to obtain estimates on the Malliavin 
covariance matrix. So let ((Tx t )i,j = < DX\, DXf >L 2 [o,t]i 1 — hJ — m - Then it is well known, see for 
example formula (240), page 110 of Nualart 1995, that 



<*x t = Y t (J Z s G(X s )a*(X s )Z*ds} Y*. 

In order to evaluate the inner integral, one has to control expressions of the type Z s V(s, X s ), where 
V(t,x) is a smooth function of t and x. Using partial integration it is easy to see that 

(36) Z t V(t,X t ) = V(0,x) + Z s [a,V}(s,X s )odW s + J Z s [- +l,V}(s, X s )ds 

= V(0,x)+ f Z s [a,V](s,X s )odW s + f Z S [V , V](s, X s )ds 
Jo Jo 

(see formula (2.10) of Kusuoka and Stroock 1985), where we recall that 



dt dt ^—f I dxi d. 
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Iterating (36) we obtain completely analogously to Theorem 2.12 of Kusuoka and Stroock 1985, for 
any L > 1, 

(37) Z s a(X s )= W (a \ S )(V 1 ) {a) (0,x) + R L (s,x,V 1 ), 

a:\\a\\<L~l 

where Rl is a remainder term and where is a multiple Wiener integral. Here, V\ = a and the 

(t4)( Q )(0, x) are the successive Lie brackets. The most important feature in the above development 
( |37[ ) is that the behavior of the remainder term depends only on the supremum norms of derivatives 
with respect to time and space of b and with respect to space of a. Then, following Kusuoka and 
Stroock 1985, we obtain their 

Corollary 4 (Corollary 3.25 of Kusuoka and Stroock 1985) For any p > 1 and t < 1, for any 

L > 1, for any x such that (Hl)(x) is satisfied, 

i/p . 1 



(38) E x (\detax t \- p Y /p <C(p,m,L) 



(V L (x) 1+ Lt) mL 



Once this control (38) is established, the upper bound (19) follows according to a well-known scheme. 
We refer the reader for instance to De Marco 2011, proof of Theorem 2.3., for a detailed presentation 
of the arguments. 
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